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Abstract It has been proposed that adaptation in complex systems is optimized 
at the critical boundary between ordered and disordered dynamical regimes. Here, 
we review models of evolving dynamical networks that lead to self-organization of 
network topology based on a local coupling between a dynamical order parameter 
and rewiring of network connectivity, with convergence towards criticality in the 
limit of large network size A^. In particular, two adaptive schemes are discussed and 
compared in the context of Boolean Networks and Threshold Networks; 1) Active 
nodes loose links, frozen nodes aquire new links, 2) Nodes with correlated activity 
connect, de-correlated nodes disconnect. These simple local adaptive rules lead to 
co-evolution of network topology and -dynamics. Adaptive networks are strikingly 
different from random networks: They evolve inhomogeneous topologies and broad 
plateaus of homeostatic regulation, dynamical activity exhibits 1 // noise and attrac- 
tor periods obey a scale-free distribution. The proposed co-evolutionary mechanism 
of topological self-organization is robust against noise and does not depend on the 
details of dynamical transition rules. Using finite-size scaling, it is shown that net- 
works converge to a self-organized critical state in the thermodynamic limit. Finally, 
we discuss open questions and directions for future research, and outline possible 
applications of these models to adaptive systems in diverse areas. 



Thimo Rohlf 

Max-Planck-Institute for Mathematics in the Sciences, Inselstrasse 22, D-04103 Leipzig, Germany 
e-mail: ro hlf @mis . mpg . de| 

Stefan Bornholdt 

University Bremen, Institute for Theoretical Physics, Otto-Hahn- Alice, 28359 Bremen, Germany 
e-mail : |bornholdt @itp . uni-bremen . de | 



1 



2 



Rohlf and Bornholdt 



1 Introduction 

Many complex systems in nature, society and economics are organized as networks 
of many interacting units that collectively process information or the flow of mat- 
ter and energy through the system; examples are gene regulatory networks, neural 
networks, food webs in ecology, species relationships in biological evolution, eco- 
nomic interaction and the internet. From an abstract point of view, one can distin- 
guish network structure, i.e. the (typically directed) graph that describes the wiring 
of interactions between the nodes the network is composed of, and network dynam- 
ics, referring to certain state variables assigned to the nodes which can change in 
response to inputs or perturbations from other nodes. In the case of the genome, for 
example, dynamics of regulatory networks, as captured in changes of gene expres- 
sion levels, results from repression and -activation of gene transcription controlled 
by regulatory inputs (transcription factors) from other genes ||251 . 

A main characteristic of all these systems is that they evolve in time, under the 
continuous pressure of adaptation to highly dynamic environments. Since network 
topology and dynamics on the network are typically tightly interrelated, this im- 
plies a co-evolutionary loop between a time-varying network wiring and adaptive 
changes in the nodes' dynamics. For example, there is evidence from the analysis 
of gene regulatory networks that interactions between genes can change in response 
to diverse stimuli ll58l . leading to changes in network toplogy that can be far greater 
than what is expected from random mutation. In the case of nervous systems, it is 
evident that self-organization and adaptation processes have to continue throughout 
the lifetime of a network, since learning is a major function of such networks. In 
this context, a major conceptual challenge lies in the fact that, in order to properly 
function as information processing systems, adaptive networks have to be, on the 
one hand, highly robust against random (or dys-functional) perturbations of wiring 
and dynamics (noise) ll9]|90l|5|, and, on the other hand, stay responsive to essential 
cues (information) from the environment that can change in time. While robust- 
ness would clearly favor highly ordered dynamics that is basically insensitive to any 
perturbation, sensitivity and adaptive pressure tend to favor an ergodic sampling of 
the accessible state space. The latter comes with the risk of leading network evolu- 
tion into regimes of chaotic dynamics with large parameter ranges where network 
dynamics is not easily controlled 1631 . 

Two interesting and interrelated questions arise; First, is there a critical point, 
given by specific values of order parameters that characterize network toplogy and 
-dynamics, where adaptive dynamics with its delicate balance between robustness 
and flexibility is optimized? Second, can we find simple, very general principles 
of network self-organization from local co-evolutionary rules that couple network 
rewiring and -dynamics such that the network globally evolves to this point? 

In the inanimate world, phase transitions from ordered to disordered dynamics at 
critical values of a system parameter are found in several classes of many particle 
systems, as for example in ferromagnets, where the system can maintain sponta- 
neous magnetization below the Curie temperature, while above this critical point 
disorder induced by thermal fluctuations wins. Similar transitions form an orga- 
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nized to a disorganized state also have been observed in living systems, for example 
in enzyme kinetics 1641 . growth of bacterial populations 1661 and brain activity l43ll . 
Most biological networks are different in many regards from the many particle sys- 
tems as considered in standard statistical mechanics. In particular, interactions be- 
tween units are typically asymmetric and directed, such that a Hamiltonian (energy 
function) does not exist. Furthermore, to make global dynamical properties acces- 
sible despite the overall stunning degree of complexity found in these networks, a 
number of simplifying assumptions have to be made. 

In this line, random Boolean networks (RBN) were proposed as simplified model 
of large gene regulatory networks l39l [88ll . In these models, each gene receives 
a constant number K of regulatory inputs from other genes. Time is assumed to 
proceed in discrete steps. Each gene ; is either "on" or "off, corresponding to a 
binary state variable (7, G {0, 1}, which can change at time t according to a (fixed) 
Boolean function of its inputs at time f — 1 (a more formal definition will be given 
in section 12.21 ). RBNs can easily be generalized to a variable number of connec- 
tions per node, and "biased" update rules Q. Despite its simple deterministic update 
rule, this model exhibits rich dynamical behavior. In particular, RBNs exhibit an 
order-disorder phase transition when each unit has on average two inputs from other 
nodeflim. 

Combinatorial and statistical methods have provided quite detailed knowledge 
about properties of RBNs near criticahty I30l[35l|4i[l7l[83l|521[l6l[l2l[lll|55l 
|53[2|4l|l2l|32l|45]|4l]|23|22|44l|79l. The second class of discrete dynamical 
networks that we will consider are Random Threshold Networks (RTN) with sparse 
asymmetric connections (for details, cf. section l23] l. Networks of this kind were first 
studied as diluted, non-symmetric spin glasses l26l and diluted, asymmetric neural 
networks l28l |47| . For the study of topological questions in networks, a version 
with discrete connections c,; = ±1 is convenient and will be considered here. It is a 
subset of Boolean networks with similar dynamical properties. Random realizations 
of these networks exhibit complex non-Hamiltonian dynamics including transients 
and limit cycles l49l [TOl . In particular, a phase transition is observed at a critical 
average connectivity Kc with lengths of transients and attractors (limit cycles) di- 
verging exponentially with system size for an average connectivity larger than Kc- 
A theoretical analysis is limited by the non-Hamiltonian character of the asymmet- 
ric interactions, such that standard tools of statistical mechanics do not apply l28ll . 
However, combinatorial as well as numerical methods provide a quite detailed pic- 
ture about their dynamical properties and correspondence with Boolean Networks 
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From the observation that complex dynamical behavior in these simple model 
systems is primarily found near criticality, Kauffman l39ll40ll and other researchers 
l9Tll50ll postulated that evolution should drive living systems to this "edge of chaos". 



The bias is typically parameterized in terms of a stochastic control parameter p, which detennines 
the probability that a particular input configuration generates the output "1". 
^ This critical connectivity Kj. = 2 refers to the simplest case, when all Boolean functions have 
equal probability to occur For the case of biased update rules, this generalizes \o = I / {2p[l — 
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Indeed, a number of parameters that are highly relevant for biological systems, as, 
for example, robustness POll and basin entropy 1461 of attractors (limit cycles), mu- 
tual information in the switching dynamics of nodes 1551 |73l and information diver- 
sity in structure-dynamics relationships ||68]| are maximized near the order-disorder 
transition of RBNs, supporting the idea that this point provides unique properties 
for balancing the conflicting needs of robustness and adaptive flexibility. Today, ex- 
perimental results provide strong support for the idea that many biological systems 
operate in a regime that shares relevant properties with criticality in random net- 
works. Indications for critical behavior were found, for example, in gene expression 
dynamics of several organisms ll82l iTOl l67l and in neuronal networks in the brain 
l52l [141 . Since, in all these systems, there generally exists no central control that 
could continously adjust system parameters to poise dynamics at the critical state, 
we sue forced to postulate that there are simple, local adaptive mechanisms present 
that are capable of driving global dynamics to a state of self-organized criticality. 
Evolution towards self-organized criticality was established in a number of non- 
equilibrium systems [|6], namely, avalanche models with extremal dynamics l8l l72ll . 
multi-agent models of financial markets l59l . forest fires l60l and models of biolog- 
ical macroevolution l3TI . Still, these approaches are limited in the sense that they 
consider a fixed or at least pre-structured topology. 

Network models of evolving topology, in general, have been studied with respect 
to critical properties earlier in other areas, e.g., in models of macro-evolution l84l . 
Network evolution with a focus on gene regulation has been studied first for Boolean 
networks in l20l observing self-organization in network evolution, and for threshold 
networks in 1211 . Combining the evolution of Boolean networks with game theoret- 
ical interactions is used for model networks in economics i71|. 

Christensen et al. 1221 introduced a static network with evolving topology of 
undirected links that explicitly evolves towards a critical connectivity in the largest 
cluster of the network. In particular they observed for a neighborhood-oriented 
rewiring rule that the connectivity of the largest cluster evolves towards the crit- 
ical Kc = 2 of a marginally connected network. However, in this model the core 
characteristics of adaptive networks, a co-evolution between dynamics and topol- 
ogy l37l . is hard to establish, since the evolution rule, here chosen according to the 
Bak-Sneppen model of self-organized criticality fJ], does not provide a direct cou- 
pling between rewiring of connections and an order parameter of the dynamics on 
the networks. 

Keeping the idea of local connectivity adaptations, a different line of research 
pursues models of adaptive co-evolutionary networks in the context of discrete dy- 
namical networks, in particular based on RBNs and RTNs. The common principle 
in these models is the coupling of local rewiring events to approximate, local mea- 
surements of a dynamical order parameter. In the limit of large network sizes A^, this 
principle leads to network evolution towards a global self-organized critical state. 
Bornholdt and Rohlf lT9l introduced a topology-evolving rule based on the dynam- 
ical activity of nodes in RTNs: Active nodes, whose binary state changes in time, 
tend to lose links, while inactive (frozen) nodes, whose binary states are fixed, tend 
to gain new links. In a recent extension l76l . also adaptive changes of the nodes' 
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activation thresholds were considered. A very similar co-evolutionary rule was ap- 
plied to RBNs by Liu and Bassler 1531 ; besides the case where only the rewired 
node is assigned a new Boolean function, they also consider "annealed" networks, 
where each node is assigned a new logical function in each evolutionary time step. 
Teuscher and Sanchez ifSTl showed that this adaptive principle can also be applied 
to turing neural networks. Self-organized critical neural networks with stochastic 
dynamics and a rewiring rule based on dynamical correlations bettween nodes was 
studied by Bornholdt and Rohl ifTsl . observing robust self-organization of both net- 
work toplogy and -dynamics. In the same context, Bertschinger et al. ifTSll studied 
a synaptic scaling rule leading to self-organized criticality in recurrent neural net- 
works. A different adaptive scheme, based on a input-dependent disconnection rule 
and a minimal connectivity in RBNs, was studied by Luque et al. 1541 . A perturba- 
tion analysisindicates the emergence of self-organized critical behavior 

The remainder of this chapter is organized as follows: in section |2] the dynam- 
ics of RBNs and RTNs are defined and basic dynamical and statistical properties 
of these systems are summarized. In particular, central order parameters that are 
relevant for the definition of adaptive algorithms will be introduced. In section [3] 
we will review different models of adaptive, discrete dynamical networks leading to 
evolution towards self-organized criticality that have been established in this context 
so far, with a focus on activity- and correlation-based rewiring rules. Finally, section 
|4]contains a summary and conclusions. 



2 Dynamics of Random Boolean Networks and Random 
Threshold Networks 

In this section, we provide definitions for the two types of discrete dynamical 
networks under consderation. Random Boolean Networks and Random Threshold 
Networks. First, the underlying graph structure that connects dynamical units (au- 
tomata) is defined, then dynamical update rules are provided. Further, basic dynam- 
ical properties of these systems are summarized. 



2.1 Underlying graph structure 

Concerning topology, discrete dynamical networks are described by random di- 
rected graphs G{N,Z,g), where is the number of nodes, Z the number of edges 
or links (arrows connecting nodes), and g a function that describes the statistical 
distribution of the links between nodes. Arrows pointing at a node are considered as 
inputs, arrows pointing from this node to another node as outputs. If, for example, 
Z links out of the 2N^ possible are assigned at random such that the average con- 
nectivity K := Z/N is fixed at a predefined value and Z <^ 2N'^ (sparse network), 
the resulting statistical distributions of the number k of inputs and outputs follow a 
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Poissonian ||34ll : 

P{k)^^exp{-K). (1) 

A schematic example of interaction graph structure is shown in the left panel of Fig. 
ffl 



2.2 Random Boolean Networks 



A Random Boolean Network (RBN) is a discrete dynamical system composed of 
automata. Each automaton is a Boolean variable with two possible states: {0, 1}, 
and the dynamics is such that 

F:{0,lf ^{0,lf, (2) 

where F = (/i ...,/Af), and each /,■ is represented by a look-up table of K, 
inputs randomly chosen from the set of automata. Initially, K, neighbors and a 
look-up table are assigned to each automaton at random. 

An automaton state (7,(f) e {0,1} is updated using its corresponding Boolean 
function: 

(7,(r + 1) = Ma,, (0, cji,{t), ...,(7,^^. (r)). (3) 

We randomly initialize the states of the automata (initial condition of the RBN). The 
automata are updated synchronously using their corresponding Boolean func- 
tions, leading to a new system state E := (c7i , aA?): 

E{t+l)=F{E{t)). (4) 

The right panel of Fig.[T]provides an example of an individual update table assigned 
to a network site. 
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Fig. 1 Left panel: example of an interaction graph structure for a RBN of size N = 5 with average 
connectivity K = 6/5; /, are individual Boolean functions assigned to each node ; = 1, ..,5, black 
circles mark Gi = I, white circles c, = 0. Right panel: example of a Boolean update table assigned 
to a site (AND function of the site's inputs). 
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Fig. 2 Schematic sketch of a threshold dynamical unit: input states (circles on the left, black circles 
correspond to a state ffy = + 1 , white circles to (Tj = — 1 ) are multiplied (O) with interaction weights 



; (lined arrows: Cjj = +1, dashed arrows: 



-1); these values are summed (Z) and added to a 



threshold. Finally, the output C7, (/ + 1) is determined by the sign (+/— ) of the resulting signal. 




' 0=3 ' ' r=4 

Fig. 3 Example of a dynamical trajectory for a W = 5 Boolean network, time is running from left 
to right, network nodes are labeled from top to bottom. Black squares correspond to CT,- = 1 , white 
squares to C; = 0. After a transient of = 3 system states E the first state A\ appears that repeats 
itself after F = 4 time steps, defining a periodic attractor (limit cycle) with period 4. 



2.3 Random Threshold Networks 

A Random Threshold Network (RTN) consists of randomly interconnected binary 
sites (spins) with states (7; = ± 1 . For each site /, its state at time f + 1 is a function 
of the inputs it receives from other spins at time t: 



C7Kf + l)-sgn(/,(f)) 



(5) 
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with 



N 



/;(0 = Lc,;(T,(f)+/t. 



(6) 



The network sites are updated synchronously. In the following discussion the 
threshold parameter h is set to zero. The interaction weights Cjj take discrete values 
Cjj = +1 or —1 with equal probability. If ; does not receive signals from j, one has 



2.4 Basic dynamical properties ofRBNs and RTNs 

Let us review a few aspects of the dynamics of Random Boolean Networks and 
Random Threshold Networks. In fact, they share most basic properties which is 
closely related to the fact that RTNs are a subset of RBNs. 

2.4.1 Attractors and transients 

Update dynamics as defined in l2.2l and l2.3l given the binary state C7, (r) of each node 
i at time f — 1, assigns a state vector E{t) ~ (di (f ), C5Ar(r)) to the network at each 
discrete time step t. The path that E{t) takes over time f is a dynamical trajectory 
in the phase space of the system. Since the dynamics is deterministic and the phase 
space of the system is finite for finite A^, all dynamical trajectories eventually be- 
come periodic. When we start dynamics from a random initial state, e.g. with each 
(7,(0), ; = l...A^ set to or 1 (—1 or +1 for RTN, respectively) independent from 
each other with equal probability = 1/2, the trajectory will pass through tran- 
sient states before it starts to repeat itself, forming a limit cycles given by 



The periodic part of the trajectory is the attractor of the dynamics, and the minimum 
F > 1 that satisfies Eq. (|2| is the period of the attractor. 

2.4.2 Definition of average activity and average correlation 

Let us now define two local measures that characterize the typical dynamical be- 
havior of a network site, and the dynamical coordination of pairs of sites. 

The average activity A{i) of a site / is defined as the average over all states (7,(r) 
site ; takes in dynamical network evolution between two distinct points of time Ti 
and T2 : 



E{t) = a{t + r). 



(7) 
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A{i) = i f a,{t) (8) 

72-7^1 + 1 r~f, 

"Frozen" sites / which do not change their states between Ti and T2 obviously have 
\A{i) I = 1 (or \A{i) | = 0, in the case of RBN), whereas sites that occasionally change 
their state have < \A{i) \ < 1. The average correlation Corr(/,y) of a pair (ij) of 
sites is defined as the average over the products ff,(f)cT,(f) in dynamical network 
evolution between two distinct points of time Ti and To : 



1 ^2 



Corr(/,y) = — - ^ (J,(0c7;(f ) 

72-7^1 + 1 



(9) 



If the dynamical activity of two sites / and j in RTN is (anti-)correlated, i.e. if O; 
and (7, always have either the same or the opposite sign, one has |Corr(i,y)| = l|5 
If the relationship between the signs of a,- and ct, occasionally changes, one has 
0<|Corr(/,;)|<l. 




Fig. 4 The frozen component C{K,N) of random threshold networks, as a function of the net- 
works' average connectivities K. For both system sizes shown here (N = 256 and N = 1024) the 
data were measured along the dynamical attractor reached by the system, averaged over 1000 ran- 
dom topologies for each value of K. One observes a transition around a value K = Ko approaching 
Kc = 2 for large N. A sigmoid function fit is also shown. To avoid trapping in exponential di- 
vergence of attractor periods for K > 2, the simulations have been limited to T„,ax = 10000. The 
mismatch of data and fit for N = 1024, K > 2.75 is due to this numerical limitation. 



' In RBN, correlated pairs have |Corr(/, = 1 and anti-correlated pairs [Corr(/, y)| = 0. 
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2.4.3 Properties of A(i) and Corr(/,;) and their relation to criticality 

If we consider statistical ensembles of randomly generated networks with sparse 
wiring {K < A^), both A{i) and Corr(i,;') of RBNs and RTNs exhibit a second or- 
der phase transition at a critical average connectivity (averaged over the whole 
network ensemble). Below Kc, network nodes are typically frozen, above Kc, a fi- 
nite fraction of nodes is active; this can be clearly appreciated from the behavior 
of the frozen component C{K), defined as the fraction of nodes that do not change 
their state along the attractor The average activity A (/) of a frozen site / thus obeys 
\A{i) \ = 1. In the limit of large A^, C{K) undergoes a transition at vanishing for 
larger K. With respect to the average activity of a node, C{K) equals the probabil- 
ity that a random site / in the network has \A{i) \ ~ 1. Note that this is the quantity 
which is checked stochastically by the local rewiring rule that will be discussed in 
section U. 1.21 The frozen component C{K,N) is shown for random networks of two 
different system sizes in Fig.|4] One finds that C{K,N) can be approximated by 

C{K,N) = i{l +tanh[-a(A^) • {K-Ko{N))]}. (10) 

This describes the transition of C{K,N) at an average connectivity Kq{N) which 
depends only on the system size A^. One finds for the finite size scaling of Kq [N) 
that 

K(i{N)-2^a-N-^ (11) 
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Fig. 5 The finite size scaling of the transition value Kq, obtained from sigmoidal fits as shown in 
Fig- El ^0 approaches K^. = 2 with a scaUng law ~ N^l^, j3 = 0.34 ±0.01. The inset shows the 
scaling behavior of the parameter a{N); one finds a{N) ~ A^'', 7= 0.41 ±0.014. 
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with a = 3.30 ±0.17 and j3 = 0.34 ±0.01 (see Fig. 4), whereas the parameter a 
scales with system size as 

a{N)=b-N^ (12) 

with b = 0.14 ±0.016 and y = 0.41 ±0.01. This indicates that the transition of 
C{K,N) exhibits a sharp decay near the critical connectivity Kc when the thermody- 
namic limit ^ oo is approached. 

The number of frozen nodes is a decisive quantity for the evolution of adaptive 
networks. If all nodes are frozen (C = 1), as it is typically found for networks with 
very sparse K, the network is basically irresponsive to signals from the environment 
and hence can neither process information nor adapt. If, on the other hand, C van- 
ishes, all nodes exhibit more or less chaotic switching behavior - dynamics becomes 
completely autonomous and hence again useless for information processing. A finite 
number of frozen nodes, as it is found near Kc, enables adaptive response to envi- 
ronmental signals by assignment of new, functional behavior to previously frozen 
nodes, and also makes sure that global network dynamics avoids the extremes of 
overly ordered and chaotic regimes. In the following section, we will discuss mod- 
els of adaptive network evolution by local dynamical rules that lead to emergence 
of self-organized critical networks, i.e. networks that evolve to the "optimal" point 
just at the phase transition from ordered to chaotic dynamics. 



3 Network self-organization from co-evolution of dynamics and 
topology 

In this section, we will discuss models of adaptive network self-organization in the 
context of discrete dynamical networks. The common principle that governs net- 
work evolution is a co-evolution of dynamics and topology from local dynamical 
rules: An order parameter of network dynamics is estimated from local measure- 
ments (often averaged over a representative number of dynamical update cycles, 
e.g., over one attractor period of a limit cycle the dynamics converged to, cf. section 
12.4.1b . Based on the measured value of the order parameter, network connectivity 
and/or the switching behavior of nodes is adapted by local adaptive rules. Usu- 
ally, there is a time scale separation between frequent dynamical updates and rare 
rewiring events. After a large number of adaptive cycles, evolution towards a self- 
organized critical state is observed. 
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3.1 Activity-dependent rewiring 
3.1.1 Motivation 

Living organisms process their information by dynamical systems at multiple lev- 
els, e.g. from gene regulatory networks at the cellular level, to neural networks in the 
central nervous system of multi-cellular organisms. As complex adaptive systems, 
organisms have to deal with the conflicting needs of flexible response to chang- 
ing environmental cues, while maintaining a reasonable degree of stability in the 
dynamical networks that process this information. This led to the idea that these 
systems may have evolved to the "edge of chaos" between ordered and disordered 
dynamical regimes Il40ll50l . In the following, a simple evolutionary mechanism will 
be introduced |fT9l , based on a local coupling between a dynamical order parameter 
- the average activity of dynamical units (sites) in RTNs (Eq. [8]) - and a topological 
control parameter - the number of inputs a site receives from other units. In a nut- 
shell, the adaptive rule can be summarized as frozen nodes grow links, active nodes 
lose links. This rule abstracts the need for both flexibility and stability of network 
dynamics. In a gene regulatory network, for example, a frozen gene cannot respond 
to different inputs it may receive, and hence is practically dysfunctional; the addi- 
tion of a new regulatory input potentially assigns a new function to this gene. On the 
other hand, a very active gene will tend to show chaotic switching behavior and may 
lead to loss of stability in network dynamics - a reduction in input number reduces 
the probability of this undesirable behavior iTSll . Similar demands for a local, home- 
ostatic regulation of activity and connectivity can be expected in neural networks of 
the nervous system and are supported by experimental evidence |[33l . 




Fig. 6 The selective criterion leading to topological self-organization: A dynamically frozen site 
(|A(i)| = 1) receives an additional regulatory input, an active site (IA(/)| < 1) looses one of its 
inputs. 
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3.1.2 Model 

Let us consider a Random Threshold Network of randomly interconnected binary 
elements as defined in section 12.31 In the beginning, network topology is initial- 
ized as a directed, random graph with connectivity distributed according to a Pois- 
sonian with average connectivity Km (cf. section 12.11 ). and Cij = + 1 or c,; = — 1 
with equal probability for non-vanishing links. While network evolution is insen- 
sitive to Kini in general (as will be shown), we choose < Km < 3 in simulations 
to obtain reasonably fast convergence of the evolutionary dynamics. Network dy- 
namics is iterated according to Eq. (|5]l starting from a random initial state vector 
i^(0) = (ai (0), C7a'(0)), with (7/ = +1 or a,- = — 1 with equal probability for each 
i. After T iterations, the dynamical trajectory eventually reaches a periodic attractor 
(limit cycle or fixed point, compare section l2.4.1b . Then we apply the following lo- 
cal rewiring rule to a randomly selected node ; of the network: If node ; does not 
change its state during the attractor, it receives a new non-zero Unk c,y from a 
random node j. If it changes its state at least once during the attractor, it loses 
one of its non-zero links c,y. Iterating this process leads to a self-organization of the 
average connectivity of the network. The basic idea of this rewiring rule is sketched 
schematically in Fig.|6] a particular algorithmic realization is provided in Box 1. 

i 

Box 1: Adaptive algorithm for activity-dependent rewiring 

This box gives an example of an adaptive algorithm that realizes the 
local rewiring rule "frozen nodes grow links, active nodes lose links" 1 191: 

1. Choose a random network with an average connectivity Km. 

2. Choose a random initial state vector Z(0) = ((7i (0), av(0)). 

3. Calculate the new system states Z{t) according to eqn. (2), using parallel 
update of the sites. 

4. Once a previous state reappears (a dynamical attractor with period F is 
reached) or otherwise after T„u,x updates the simulation is stopped. Then, 
a site / is chosen at random and its average activity A{i) during the last 
T —F time steps is determined (in case no attractor is reached, T — Tmax/2 
is chosen). 

5. If \A{i)\ = 1, i receives a new link cij from a site j selected at random, 
choosing Cij ~ +1 or —1 with equal probability. If |A(;)| < 1, one of the 
existing non-zero links of site / is set to zero. 

6. Finally, one non-zero entry of the connectivity-matrix is selected at random 
and its sign reversed. 

7. Go to step number 2 and iterate. 
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3.1.3 Results 

The typical picture arising from the model as defined above is shown in Fig. |7] 
for a system of size = 1024. Independent of the initial connectivity, the system 
evolves towards a statistically stationary state with an average connectivity Kev{N — 
1024) = 2.55 ±0.04. With varying system size we find that with increasing the 
average connectivity K approaches Kc (which, for threshold /i = as considered 
here, is found slightly below K = 2 llTTl ). see Fig. |8] In particular, one can fit the 
scaling relationship 

K,,.{N)~2 = c-N-^ (13) 

to the measured connectivity values with c = 12.4±0.5 and 8 = 0.47 ±0.01. In the 
evolutionary steady state, the average connectivity K of evolving networks exhibits 
limited fluctuations around the evolutionary mean Kevo which are approximately 
Gaussian distributed, with a variance vanishing ~ 1 /N ll74l . 

Going beyond averaged topological quantities, one can also measure the degree 
distributions of inputs and outputs in evolving networks, and compare it to what is 
expected for random networks (cf. section |7.4.3t . In finite size networks, substantial 
deviations from random graphs are found [78l: While the outdegree distribution 
stays close to the Poissonian of a random graph, evolved in-degree distributions are 
considerably flatter. For the averaged statistical distribution p{K) of in-links (Fig. 
|9]l of the evolving networks one observes a flat exponential decay 
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Fig. 7 Evolution of the average connectivity of threshold networks rewired according to the rules 
described in the text, for N = 1024 and two different initial connectivities (.ST,,,,- =1.5 and A",,,, = 
3.0). Independent of the initial conditions chosen at random, the networks evolve to an average 
connectivity K„ = 2.55 ± 0.04. The plot shows the time series and the corresponding cumulative 
means for K^,. . The evolutionary time / is discrete, each time step representing a dynamical run on 
the evolved topology. Individual runs were limited to T,,,,,, = 1000 iterations. 
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p{K)^Po-exp[-aK], (14) 

with p(),a — const. This observation indicates that the self-organized network state, 
at least for finite A^, is substantially different from random networks with the same 
average connectivity. Since network evolution is based on co-evolutionary adapta- 
tion of dynamics and topology by local rewiring rules, this raises the question of 
whether the evolutionary statistically stationary state exhibits specific characteris- 
tics and correlations between dynamical and toplogical order parameters also on the 
global scale. This is indeed the case for finite A^: If we compare, for example, the 
frozen component C{K) or fraction of "frozen genes" for different values of connec- 
tivity fluctuations around the evolutionary mean Ke„, (Fig.fTOli. we observe that this 
curve exhibits a broad plateau where activity is stabilized at intermediate values, 
with almost step-like boundaries for small and large K, whereas the correspond- 
ing curve for random networks is much smoother and decays earlier (compare also 
section 12.4.31 for the phase transition observed in ensembles of random networks). 
This indicates that coevolution of dynamics and topology extends to a global scale, 
in spite of local rewiring events and a pronounced time scale separation between 
dynamical and topological updates^. 

Last, let us characterize dynamics on the evolving networks, and investigate in 
how far it may exhibit signatures of self-organized critical behavior even in the fi- 
nite size networks we studied so far (which, concerning average connectivity, are 
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Fig. 8 The average connectivity of the evolved networks converges towards Kc with a scaling law 
^N^^, 5 = 0.47±0.01. For systems with W < 256 the average was taken over4- 10^ time steps, 
for N = 512 and N = 1024 over 5 • 10^ and 2.5 • 10^ time steps, respectively. Finite size effects 
from T,„ax = 1000 may overestimate K^y for the largest network shown here. 



This time scale separation can be easily identified e.g. from step 4 of the adaptive algorithm 
summarized in Box 1: After T dynainical system updates, one out of A' sites is rewired, hence time 
scale separation is at the order of T ■ N. 
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evidently super-critical). In contrast to random, noise-driven dynamics, where cor- 
relations decay fast (typically as an exponential), the self-organized critical state 
is characterized by non-trivial, long-range correlations in dynamical trajectories. A 
convenient measure to characterize such long-range correlations is the power spec- 
trum of the dynamical time series. Let us consider the autocorrelation function of a 
time signal /(?), defined by 



m= fy{t)f{t-x)dt. 



(15) 



The power spectrum G{f) is the Fourier transform of the autocorrelation function, 
i.e. 

G(/) - /^"/?(T)e-2-/VT. (16) 

J— CO 

In the case of time-discrete systems, the integrals are replaced by the corresponding 
sums. For strongly (auto-)correlated systems, e.g. near the critical point, we typi- 
cally expect a flat decay of the power spectrum G{f) ~ 1 //" with a « 1, while for 
a random walk, e.g., we would obtain a = 2. The dynamical order parameter that 
we investigate is the global average activity at evolutionary time step t: 



m) = 



1 ^ 



(17) 



Figure [TT| shows a typical snapshot of the time series of (A) on evolving networks, 
the power spectrum is shown in Fig. [121 A least squares fit yields G(/) ^ 1 //" with 
a = 1 .298 for the global average activity, i.e. a clear indication of long-range corre- 
lations in dynamics Il74l . Other measures of global dynamics also show evidence for 
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Fig. 9 Statistical distribution piK) of the number of inputs K per node (gene) in the proposed 
model for a network of size A' = 64. Compared to the Poisson distribution for random networks 
with K = 4.46, it shows a flatter decay <x exp [—K]. 
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criticality, for example, the statistical distribution of attractor periods is scale-free, 
as will be discussed in section [33] for a RBN variant of the model. 

The self-organization towards criticality observed in this model is different from 
other known mechanisms exhibiting the amazingly general phenomenon of self- 
organized criticality (SOC) [S] |2l |72] 184] . Our model introduces a (new, and in- 
terestingly different) type of mechanism by which a system self-organizes towards 
criticality, here K Kc- This class of mechanisms lifts the notions of SOC to a new 
level. In particular, it exhibits considerable robustness against noise in the system. 
The main mechanism here is based on a topological phase transition in dynamical 
networks. 

In addition to the rewiring algorithm as described in this chapter, a number of dif- 
ferent versions of the model were tested. Including the transient in the measurement 
of the average activity A (;) results in a similar overall behavior (where we allowed a 
few time steps for the transient to decouple from initial conditions). Another version 
succeeds using the correlation between two sites instead of A{i) as a mutation cri- 
terion (this rule could be called "anti-Hebbian" as in the context of neural network 
learning). In addition, this version was further changed allowing different locations 
of mutated links, both, between the tested sites or just at one of the nodes. All these 
different realizations exhibit the same basic behavior as found for the model above. 
Thus, the proposed mechanism exhibits considerable robustness. Interestingly, it 
has been shown that this mechanism leads to robust topological and dynamical self- 
organization also in other classes of dynamical networks. In particular, Teuscher and 
Sanchez ISTl showed that this rule can be generalized to Turing neural networks and 
drives network evolution to Kc = 2 in the limit of large A^. 

In the next subsection, we will discuss an extension of the model that includes 
adaptation of thresholds in RTN, in addition to rewiring of links. This extension still 
exhibits robust self-organization as in the original model, however, exhibits several 
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Fig. 10 The frozen component C (fraction of frozen genes) as a function of the average connec- 
tivity for an evolved network of size N = 64 (crosses). The dashed line shows the corresponding 
curve for random networks. 
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interesting new features, namely, symmetry breaking of evolutionary attractors, and 
correlation of dynamical and toplogical diversity. 



3.2 Adaptive thresholds - time scale separation leads to complex 
topologies 

So far, we assumed that dynamical units in the networks are homogeneous (identi- 
cal) with respect to their switching behavior, which for real world networks usually 
is a quite unrealistic assumption. Furthermore, recent studies have shown that in- 
homogeneity of thresholds leads to new and unexpected phenomena in RTNs, e.g. 
an order-disorder transition induced by correlations between thresholds and input 
number of nodes ifTSl . In the general case of inhomogeneous thresholds, we have to 
modify Eq.|5]such that 

N 

/;(f) = l^Q;(j^(f (18) 

where the indexed threshold hi now takes into account that thresholds can vary from 
node to node. The only restriction we impose is /j, < 0, to make activation, i.e. 
<7, = +1, more difficult. 

We now introduce a minimal model linking regulation of activation thresholds 
and rewiring of network nodes in RTNs to local measurements of a dynamical or- 
der parameter 1761 . Adaptation of thresholds opens up for the possibility of units 
that become heterogeneous with respect to their dynamical properties: Nodes with 
high thresholds are inert and switch their state only for few input configurations 
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(similar to the effect of canalizing functions in RBNs), whereas nodes with low 
thresholds are more likely to switch. A new control parameter p G [0, 1] determines 
the probability of rewiring vs. threshold adaptations. In particular, the activity A{i) 
of a site ; can be controlled in two ways: If / is frozen, it can increase the proba- 
bility to change its state by either increasing its number of inputs ki ^ + 1, or 
by making its threshold hi < less negative, i.e. | | — 1. If ; is active, it can 
reduce its activity by adapting either ki A;,- — 1 or \hi\ — > \ + 1. To realize this 
adaptive scheme, we have to modify step 4 in the adaptive algorithm of Box 1 : A 
site / is chosen at random and its average activity A{i) during the last T ~ F 
time steps is determined (in case no attractor is reached, T = r„,„v/2 is chosen). 
If \A{i) \ < 1, then fc, k, — 1 with probability p (removal of one randomly se- 
lected input). With probability 1 — p, adapt \hi\ + 1 instead. If A(;)| = 1, 
then ki ki + l with probability p (addition of a new input from a randomly 
selected site). With probability 1 p, adapt /?,! j/i, 1 instead. If /?, ~ 0, let 
its value unchanged. If the control parameter p takes values p > 1/2, rewiring of 
nodes is favored, whereas for p < 1/2 threshold adaptations are more likely. Notice 
that the model discussed in the last subsection is contained as the limiting case p = l 
(rewiring only and /i, — const. — for all sites). 

Results. After a large number of adaptive cycles, networks self-organize into a 
global evolutionary steady state. An example is shown in Fig. [13] for networks 
with = 512: starting from an initial value A",,,, = 1, the networks' average con- 
nectivity K first increases, and then saturates around a stationary mean value Kevo', 
similar observations are made for the average threshold h (Fig. [13] lower panel). 
The non-equilibrium nature of the system manifests itself in limited fluctuations 
of both K and Ji around Kevo and Jievo- Regarding the dependence of K with re- 
spect to p, we make the interesting observation that it changes non-monotonicaUy. 
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Fig. 12 Power spectrum of the global average activity (A) over lO' evolutionary time steps, aver- 
aged over all network sites (compare upper curve in Fig. (TTj double-logarithmic plot. The dashed 
line has slope —1.298. 
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Two cases can be distinguished: When p ^ I, K stabilizes at a very sparse mean 
value Kgya, e.g. for = 512 at = 2.664 ±0.005. When p < 1, the symme- 
try of this evolutionary steady state is broken. Now, K converges to a much higher 
mean value Kgvo ~ 43.5 ±0.3 (for — 512), however, the particular value which 
is finally reached is independent of p. On the other hand, convergence times Tcon 
needed to reach the steady state are strongly influenced by p: Tcon [p) diverges when 
p approaches 1 (compare Fig. 2 for p ~ 0.99). We conclude that p determines the 
adaptive time scale. This is also reflected by the stationary in-degree distributions 
p{ki„) that vary considerably with p (Fig.[T4b: when p — > 1, these distributions be- 
come very broad. The numerical data suggest that a power law 

limpfc)-^J (19) 

with 7 « 3/4 ±0.03 is approached in this limit (cf. Fig. 4, dashed line). At the 
same time, it is interesting to notice that the evolved out-degree distributions are 
much narrower and completely insensitive to p (Fig. [14] data points without lines). 
Hence, we make the interesting observation of a highly robust self-organization and 
homeostatic regulation of the average wiring density, while, at the same time in 
the limit p I, time scale separation between frequent rewiring and rare threshold 
adaptation leads to emergence of complex, heterogeneous topologies, as reflected 
in the broad distribution of input numbers approaching a power law. Obviously, we 




Fig. 13 Upper panel: Evolution of the average connectivity K of threshold networks, using the 
adaptive algorithm (cf. Fig. 1), for A' = 512 and initial connectivity ^,„, = 1. Time series for five 
different values of p are shown. Lower panel: The same for the average threshold h. 
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have a non-trivial coevolutionary dynamics in the hmit p ^ I which is significantly 
different from the limit of small p. This is also indicated by the emergence of strong 
correlations between input number and thresholds in this limit (see the steep increase 
of the curves for p > 0.5 in Fig. [TSl l. while in the limit of small p correlations are 
weak. 

To summarize, we find that coevolution of both rewiring and threshold adaptation 
with the dynamical activity on RTNs leads to a number of interesting new effects: 
We find spontaneous symmetry breaking into a new class of adaptive networks that 
is characterized by increased heterogeneity in wiring topologies and emergence of 
correlations between thresholds and input numbers. At the same time, we find a 
highly robust regulation of the average wiring density which is independent of p for 
any p <l. 
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Fig. 14 Line-pointed curyes: in-degree distributions of evolved networks, data points only: the cor- 
responding out-degree distributions ((A) p = 0.3, {+) p = 0.5, (x) p = 0.8, (*) p = 0.95, (squares) 
p = 0.99). Statistics was gathered over 10* evolutionary steps, after a transient of 4 ■ 10* steps. 
Networks had size W = 512. The dashed line has slope —3/4. 
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Fig. 15 Average number (k/,,) of inputs for a given node in evolving networks, as a function of 
the respective nodes (absolute) threshold \h\. Statistics was taken over 10* rewiring steps, after a 
transient of 4- 10* steps. For all values p < 1, a clear positive correlation between kj,, and \h\ is 
found. 
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In the next subsection, we will discuss another generalization of the adaptive, co- 
evolutionary scheme of activity-dependent rewiring to Random Boolean Networks, 
which was introduced by Liu and Easier 1531 . 



3.3 Extension to Random Boolean Networks 

Activity-dependent rewiring was originally introduced for Random Threshold Net- 
works, as discussed in section [3.1.21 the basic adaptive scheme, however, can be 
generalized to other classes of dynamical systems. Since RTN are a subclass of 
Random Boolean Networks, one possible direction of generalization is to apply this 
coevolutionary, adaptive rule to RBNs. Compared to RTNs, rewiring by local dy- 
namical rules in RBN comes with an additional complication: While in RTNs the 
dynamical transition rule is the same for all network sites (the evaluation of the 
weighted sum of regulatory inputs, cf. Eq. |6]l, switching of network nodes in RBNs 
is governed by individual logical functions that vary from node to node and depend 
on the input number k. If, for example, we have a node with two inputs and a logical 
AND function of these two inputs assigned (compare the example in Fig. [Til, there 
does not exist a well-defined mapping that would assign a new logical function to 
this node in the case we change its input number to k= 1 or A: = 3. 

Liu and Bassler 153 1 suggested two variants of activity-dependent rewiring to 
overcome the problem associated to the reassignment of logical functions: in the 
first variant, only the node that is rewired at evolutionary time step t is assigned 
a new logical function which is randomly drawn out of the 2^ possible Bollean 
functions of k inputs (where k is the new input number after rewiring). The adaptive 
algorithm that was applied in this study is summarized in Box 2. 

Box 2: Adaptive algorithm for activity-dependent rewiring in RBN 

1. Start with a homogeneous RBN, G{N,Ko) with uniform in-degree connec- 
tivity Ki — A'o for all A^, and generate a random Boolean function fi for 
each node /. 

2. Choose a random initial system state E{Q). Update the state using Eq. [4| 
and find the dynamical attractor. 

3. Choose a node ; at random and determine its average activity A (/) over the 
attractor. 

4. Change the network topology by rewiring the connections to the node cho- 
sen in the previous step. If it is frozen, then a new incoming link from 
a randomly selected node j is added to it. If it is active, then one of its 
existing links is randomly selected and removed. 

5. The Boolean functions of network are regenerated. Two different methods 
have been used: 
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• Annealed model: A new Boolean function is generated for every node 
of the network. 

• Quenched model: A new Boolean function is generated only for the 
chosen node /, while the others remain what they were previously. 

6. Return to step 2. 
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Fig. 16 (a). Evolution of the ensemble averaged in-degree connectivity in the annealed model, as 
studied by Liu and Bassler 1531 , for networks of size A' = 30. The networks in each ensemble 
initially start from different uniform connectivity, Kq = 2,3,4, and 5, but reach a same statistical 
steady state {K) = 3.06. (b). Evolution of ensemble averaged in-degree connectivity for networks 
of three different size A' = 30, 50, and 100 in the annealed model. 




Fig. 17 Power law distribution of steady state attractor period F in both annealed (circle) and 
quenched (square) models as studied by Liu and Bassler 1531 . for N = 200 systems. The dashed 
straight line has a slope of 1.0. 
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For simplicity, all random Boolean functions are generated with p = 1/2, and 
therefore all Boolean functions with the same in-degree are equally likely to be 
generated. 

Results. Liu and Bassler show that for both variants of the model, robust self- 
organization of network topology is found. Independent from the initial network 
realization, network evolution always converges to a characteristic average connec- 
tivity Kev{N). Graph (a) of Fig. [T6l shows the evolution of the average in-degree 
connectivity K for networks of size = 30 in the annealed variant of the model, 
with results obtained by beginning with networks with different uniform connectiv- 
ity Kq = 2, 3, 4, and 5. Each curve is the average of 15,000 independent realizations 
of the network evolution. All curves approach the same final statistical steady state 
that has an average in-degree connectivity (K) ~ 3.06. The steady state value of (K) 
depends on the size of the system as shown in graph (b) of Fig. [16] Starting with 
networks that all have the same initial uniform connectivity Kq = 4, but which have 
different size = 30,50, and 100, one finds that larger networks evolve to steady 
states with smaller values of {K). 

Given the steady state value {K) = 2 in the large network limit N °°, Liu and 
Bassler also studied the finite-size effects in the model. They found that the values 
of {K{N)) for finite obey the scaling function 

(K{N))-2^cN-^. (20) 

Fitting the data to this function, we find that the coefficient is c = 2.50 ± 0.06 and 
the exponent is 5 = 0.264 ± 0.005. Thus the value of {K{N)) is always larger than 2 
for finite A^. Note that steady state values of the average connectivity in RTNs have 
a similar scaling form, but with slightly different values of the scaling parameters 
(cf. section[3X3lEq.[T3ll. 

In order to probe the dynamical nature of evolved steady states the authors com- 
puted the distribution of steady state attractor period F in the ensemble of 
RBNs simulated. The distribution has a broad, power-law behavior for both the an- 
nealed and quenched variants of the model. Figure[T7]shows the results for networks 
with A^ = 200. A power-law distribution of attractor periods is a typical signature of 
critical dynamics, hence, similar to the results discussed in section 13.1.31 for the 
self-organization of the global average activity, this finding indicates that dynamics 
exhibits close-to critical behavior already for finite size networks, while toplogical 
criticality is attained in the limit of large A^. 

To summarize, the results of this study give strong evidence that the local, adap- 
tive coevolutionary principle /rozen nodes grow links, active nodes lose links leads 
to robust self-organization not only in RTNs, but also in the more general class of 
RBNs, and hence has the potential to be generaUzed to large classes of dynamical 
systems. 
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3.4 Correlation-based rewiring in neural networks 

In this section, we will review a different adaptive coeveolutionary scheme of net- 
work self-organization which is based on the basic paradigm correlated activity 
connects, decorrelated activity disconnects. This local, topology-evolving rule is in- 
spired by the idea of Hebbian learning in neural networks |[38l . and, consequently, 
was studied first for discrete neural networks with architectural and dynamical con- 
straints motivated by corresponding observations in the brain ifTSll . In particular, 
an explicit parameterization of space on a two-dimensional grid is given, and dy- 
namics is not deterministic any more, in contrast to the models discussed in the 
previous sections. The core result of this study is that network self-organization 
by correlation-driven rewiring is robust even when spatial constraints are present 
and dynamics is affected by noise. Correlation-driven rewiring can be considered as 
a natural extension of the basic, activity-driven rewiring, as it exploits long range 
correlations naturally emerging near phase transitions, and thereby is particularly 
suited for neural networks where information processing takes place typically in 
form of correlated activity. Let us now briefly motivate the correlation based self- 
organization in the context of neural networks. 

Neural networks with asymmetric connectivity patterns often exhibit regimes of 
chaotic dynamics 1631 . In networks whose central function is information transfer, 
these regimes would instantly render them useless. Consider, for example, model 
neural networks with asymmetric synaptic couplings, where a percolation transition 
between regimes of ordered and disordered dynamics is known ll48l . In the disor- 
dered phase, which occurs for densely connected networks, already small perturba- 
tions percolate through the networksO In such networks, developmental processes 
that change connectivity always face the risk of driving the network into the highly 
connected regime (where chaotic dynamics prevails), as long as no explicit mecha- 
nism is given that controls the global degree of connectivity. 

In a correlation-based rewiring rule we will exploit that also the average correla- 
tion between the activities of two neurons contains information about global order 
parameter of network dynamics. The network can then use this approximate or- 
der parameter to guide the developmental rule. A possible adaptive scheme is that 
new synaptic connections preferentially grow between correlated neurons, as sug- 
gested by the early ideas of Hebb 1381 and the observation of activity-dependent 
neural development ||89l l62l [33l |69l . In the remainder of this section let us reca- 
pitulate this problem in the framework of a specific toy model ITSl . First a neural 
network model with a simple mechanism of synaptic development is defined. Then, 
the interplay of dynamics on the network with dynamics of the network topology is 
modeled. Finally, robustness of self-organizing processes in this model and possible 
implications for biological systems are discussed. 



^ This is reminiscent of avalanche-like propagation of activity in the brain which is observed in 
some diseases of the central nervous system 1811 . 
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3.4.1 Model 

Let us consider a two-dimensional neural network with random asymmetric weights 
on the lattice. The neighborhood of each neuron is chosen as its Moore neighbor- 
hood with eight neighbors0The weights Cij are randomly drawn from a uniform dis- 
tribution c,j G [—1,+!] and are nonzero between neighbors, only. Note that weights 
dj are asymmetric, i.e., in general, ctj ^ cji. Within the neighborhood of a node, a 
fraction of its weights Cij may be set to 0. The network consists of neurons with 
states (J,- = ±1 which are updated in parallel with a stochastic Little dynamics on 
the basis of inputs received from the neighbor neurons at the previous time step: 

(y.(^t + l) = l^^ probability gp {fi (f ) ) ^ ^ 

1—1 with probabiUty I — gpifiit)) 

where 

with the inverse temperature j3. The transfer function /, (f ) is evaluated according to 
Eq. [18] that defines dynamics of threshold units with individually assigned thresh- 
olds. The threshold is chosen here as li, = —0.1 + 7 and includes a small random 
noise term 7 from a Gaussian of width e. This noise term is motivated by the slow 
fluctuations observed in biological neural systems HHJl- 

The second part of the model is a slow change of the topology of the network 
by local rewiring of synaptic weights: If the activity of two neighbor neurons is 
on average highly correlated (or anticorrelated), they will obtain a common link. If 
their activity on average is less correlated, they will lose their common link. The 
degree of correlation in the dynamics of pairs of nodes is quantified by the average 
correlation, as defined in Eq. |9] in section 12.4.21 The full model dynamics is then 
realized by the algorithm summarized in Box 3. 



Box 3: Adaptive algorithm for correlation-dependent rewiring in neural 
networks 



1. Start with a random network with an average connectivity (number of 
nonzero weights per neuron) ^r,„, and a random initial state vector E (0) = 

(C71(0),...,C7^(0)). 



* The choice of the type of neighborhood is not critical, however, here the Moore neighborhood 
is more convenient than the von Neumann type since, in the latter case, the critical link density 
(fraction of nonzero weights) at the percolation threshold accidentally coincides with the attractor 
of the trivial developmental rule of producing a link with p = 0.5. In general, also random sparse 
neighborhoods would work as demonstrated in [21| . 
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2. For each neuron /, choose a random threshold hj from a Gaussian distribu- 
tion of width e and mean /i. 

3. Starting from the initial state, calculate the new system state applying Eq. 
|2l]using parallel update. Iterate this for T time steps. 

4. Randomly choose one neuron / and one of its neighbors j and determine the 
average correlation according to Eq.[8]over the last t/2 time steps. (Alter- 
natively, the correlation can be obtained from a synaptic variable providing 
a moving average at any given time). 

5. If |Corr(/,y)| is larger than a given threshold a, / receives a new hnk Cij 
from site j with a weight chosen randomly from the interval G [— 1 , l]|j 
If |Corr(i,7)| < a, the link c,y is set to (if nonzero). 

6. Go to step 2 and iterate, using the current state of the network as new initial 
state. 



The dynamics of this network is continuous in time, with neuron update on a fast 
time scale and topology update of the weights on a well-separated slow "synaptic 
plasticity" time scale. Note that the topology-changing rule does not involve any 
global knowledge, e.g., about atti-actors. 
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Fig. 18 Evolved average connectivity Kg^, as a function of the inverse temperature j8 . Each point is 
averaged over 10^ time steps in a network of size N = 64 and a = 0.5. After Bomholdt and Rohl 

m. 



28 



Rohlf and Bornholdt 



3.4.2 Results 

Independent of the initial conditions the networks evolve to a specific average con- 
nectivity. Parameters are j3=25,e=0.1,a correlation cutoff a = 0.8, and an aver- 
aging time window of T = 200. One observes that the continuous network dynamics, 
including the slow local change of the topology, results in a convergence of the av- 
erage connectivity of the network to a characteristic value which is independent of 
initial conditions. 

Finite size scaling of the resulting average connectivity indicates the convergence 
towards a characteristic value for large network size and exhibits the scaling rela- 
tionship 

Key{N)=aN-^+b (23) 

with fl = 1 .2 ± 0.4, 5 = 0.86 ± 0.07, and b = 2.24± 0.03. Thus, in the large sys- 
tem size limit N ^ °° the networks evolve towards K^. ~ 2.24 ±0.03. The self- 
organization towards a specific average connectivity is largely insensitive to ther- 
mal noise of the network dynamics, up to « 10% of thermal switching errors (or 
J3 > 10) of the neurons. This indicates that the structure of a given dynamical attrac- 
tor is robust against a large degree of noise. Figure [18] shows the evolved average 
connectivity as a function of the inverse temperature j5 . 

While the stability of dynamical attractors on an intermediate time scale is an 
important requirement for the local sampling of neural correlation, on the long time 
scale of global topological changes, switching between attractors is necessary to 
ensure ergodicity at the attractor sampling level. The second source of noise, the 
slow random change in neural thresholds as defined in step (2) of the algorithm, is 
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Fig. 19 Histogram of Corr(!,y) for a network evolving in time, with N = 64 and /3 = 10, taken 
over a run of 4 x 10^ time steps, according to the model of Bornholdt and Rohl 1181 . 
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closely related to such transitions between attractors. While, in general, the model 
converges also when choosing some arbitrary fixed threshold h and omitting step (2) 
from the algorithm, a small threshold noise facilitates transitions between limit cycle 
attractors [61] and thus improves sampling over all attractors of a network, resulting 
in an overall increased speed and robustness of the convergence. An asynchronous 
change of the threshold /i,-, updating one random /z,- after completing one sweep 
(time step) of the network, leads to similar results as the parallel rule defined above. 

The basic mechanism of the observed self-organization in this system is the weak 
coupling of topological change to an order parameter of the global dynamical state 
of the network, and thus is different from the mechanism of extremal dynamics, 
underlying many prominent models of self-organized criticality |[8]|7l. To illustrate 
this, let us for a moment consider the absolute average correlation |Corr(/ , j) \ of two 
neurons which is the parameter used as a criterion for the rewiring process. It can 
be shown that this quantity undergoes a phase transition depending on the average 
connectivity K which is similar to the transition of the frozen component observed 
in RTN (FiglH cf. section lZ4.3l ). Note that the correlation is large for networks with 
small connectivity, and small for networks that are densely connected. The rewiring 
rule balances between these two regimes: For high correlation, it is more likely that 
a link is created, at low correlation, links are vanishing. The balance is reached most 
likely in the region of the curve where the slope reaches its maximum, as here the 
observed correlation reacts most sensitively to connectivity changes. As the steep 
portion of the correlation curve occurs in a region of small connectivities where 
also the critical connectivity Kc « 2 of the network is located, this makes the corre- 
lation measure sensitive to the global dynamical state of the network and potentially 
useful as an approximation of the order parameter Synaptic development dependent 
on averaged correlation between neurons can thus obtain approximate information 
about the global dynamical state of the network as is realized in the above toy model 
with a simple implementation on the basis of a threshold a. The exact choice of the 
threshold a is not critical, which can be seen from the histogram of the absolute 
correlation shown in Fig.[T9]for a typical run of the model. Correlations appear to 
cluster near high and near low values such that the cutoff can be placed anywhere 
inbetween the two regimes. Even a threshold value close to 1, as compared with the 
correlation cutoff a = 0.8 used in the simulations here, only leads to a minor shift 
in Kev and does not change the overall behavior 

Up to now we focused on changes of the network structure as a result of the 
dynamics on the network. A further aspect is how the structural changes affect the 
dynamics on the network itself. Do also dynamical observables of the networks 
self-organize as a result of the observed convergence of the network structure? An 
interesting quantity in this respect is the average length of periodic attractors. 

Indeed, this dynamical observable of the network dynamics converges to a spe- 
cific value independent of the initial network, similarly to the convergence of the 
structural parameter^ considered earlier. From the K dependency of the neural pair 
correlation we have seen above that the rewiring criterion tends to favor connec- 
tivities near the critical connectivity of the network. Does also the evolved average 
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attractor length relate to critical properties of the percolation transition? An approx- 
imate measure of this aspect is the finite size scaling of the evolved average period. 

For static networks we find that the attractor lengths typically scale exponentially 
with in the overcritical regime, but less than linearly in the ordered regime. For the 
evolved connectivity Kev in our model, we observe scaling close to criticality. Large 
evolved networks exhibit relatively short attractors, which otherwise for random 
networks in the overcritical regime could only be achieved by fine tuning. The self- 
organizing model studied here evolves non-chaotic networks without the need for 
parameter tuning. 

In a continuously running network, robust self-organization of the network to- 
wards the percolation transition between ordered and disordered dynamics is ob- 
served, independent of initial conditions and robust against thermal noise. The basic 
model is robust against changes in the details of the algorithm. We conclude that a 
weak coupling of the rewiring process to an approximate measurement of an order 
parameter of the global dynamics is sufficient for a robust self-organization towards 
criticality. In particular, the order parameter has been estimated solely from infor- 
mation available on the single synapse level via time averaging of correlated neural 
activities. 



4 Summary and Outlook 

We reviewed models of topological network self-organization by local dynamical 
rules. Two paradigms of local co-evolutionary adaptation were applied to discrete 
dynamical networks: The principle of activity-dependent rewiring (active nodes lose 
links, frozen nodes aquire new links), and the principle of correlation-dependent 
rewiring (nodes with correlated activity connect, decorrelated nodes disconnect). 
Both principles lead to robust self-organization of global network topology and - 
dynamics, without need for parameter tuning. Adaptive networks are strikingly dif- 
ferent from random networks: they evolve inhomogeneous topologies and broad 
plateaus of homeostatic regulation, dynamical activity exhibits 1// noise and at- 
tractor periods obey a scale-free distribution. The proposed co-evolutionary mecha- 
nism of topological self-organization is robust against noise and does not depend on 
the details of dynamical transition rules. Using finite-size scaling, it was shown that 
networks converge to a self-organized critical state in the thermodynamic limit. 

The proposed mechanisms of coevolutionary adaptation in dynamical networks 
are very robust against changes in details of the local rewiring rules - in particular, 
they only require a local estimate of some dynamical order parameter in order to 
achieve network adaptation to criticality. 

A classical route to self-organized criticality is the feedback of an order param- 
eter onto local dynamics of a system ll85l . The local rewiring rules considered here 
extend this idea to using only approximate local estimates of a global order parame- 
ter As seen in the examples above, locally measured averages prove to be sufficient 
for self-organized criticality. In particular, in the presence of a time-scale separation 
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between fast dynamics on the networks and slow topology evolution, the evolution- 
ary steady state naturally provides a quasi-ergodic sampling of the phase space near 
the critical state, such that accurate order parameter values are not necessary. In the 
models considered in this review, an estimate of the order parameter is achieved by 
local averaging over the switching activity of single nodes, or over the dynamical 
correlation of pairs of nodes. 

A number of open questions remains to be addressed in the context of the class 
of adaptive networks considered here. The robust network self-organization ob- 
served in the models, approaching criticality in the limit of large A^, is far from 
being understood in detail. With regard to dynamics, evolving networks exhibit pro- 
nounced differences to random networks with comparable connectivity. In partic- 
ular, the frozen component exhibits for finite a plateau around the evolutionary 
mean Kem, with step-like discontinuities when the average wiring density substan- 
tially departs from Kgvo (Fig- flOb ; for comparison, the corresponding curves for 
random networks show a smooth decay. This may suggest that the self-organized 
critical state rather exhibits characteristics of a first order phase transition, while 
order parameters in random discrete dynamical networks typically exhibit second 
order transitions at Kc- With regard to topology, deviations from random networks 
become particularly pronounced when dynamical units are allowed to diversify with 
respect to their switching behavior during evolution, leading to symmetry breaking 
and emergence of scale-free in-degree distributions; again, these observations are 
hard to explain in the context of the traditional statistical mechanics approach based 
on random ensembles of networks. 

In the studies reviewed in this chapter, evolving networks were treated as com- 
pletely autonomous systems, without coupling to an external environment. An im- 
portant step in future research will be to introduce network-environment interaction 
and study network evolution under the influence of external signals or perturbations; 
this also connects to the particularities of information processing in self-organized 
critical networks, and the idea of optimal adaptation at the "edge of chaos" lfT5l . 

Finally, let us widen the scope of these models beyond their theoretical value, 
and discuss possible applications. 

On the one hand, they represent prototypical models of self-organized critical 
dynamical networks, toy models that demonstrate possible mechanisms for dynam- 
ical networks to adapt to criticality. On the other hand, these mechanisms are not 
limited to the extremely simple toy models discussed here, and may themselves 
occur in natural systems. They do not depend on fine-tuning of parameters or de- 
tails of the implementation, and they are robust against noise. This is contrary to 
standard mechanisms of self-organized criticality 18] I?) which are sensitive to noise 
llSOl and, therefore, not easily applied to natural systems. Network self-organization 
as reviewed above, however, is itself defined on the basis of stochastic dynamical 
operations (update of randomly selected links, noisy local measurement of order 
parameter, for example). We therefore expect that these mechanisms can occur in 
natural systems quite easily. 

A strong need for adaptive mechanisms is present in nervous systems, where 
assemblies of neurons need to self-adjust their activity levels, as well as their con- 
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nectivity structure 1891 [T3l [86l [36l . The mechanism discussed here is one possible 
route to adaptivity in natural neural networks. It can serve as the basis for more 
biologically detailed models ifTSl [T4l [511 . 

Further applications of the network adaptation models are conceivable, e.g. to 
socio-economic systems. Network adaptation could in principle occur in adapting 
social links or economic ties of humans acting as agents in complex social or eco- 
nomic systems. 
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